JEC-QA: A Legal-Domain Question Answering Dataset

We present JEC-QA, the largest question answering dataset in the legal domain, collected from the National Judicial Examination of China. The examination is a comprehensive evaluation of professional skills for legal practitioners. College students are required to pass the examination to be certified as a lawyer or a judge. The dataset is challenging for existing question answering methods, because both retrieving relevant materials and answering questions require the ability of logic reasoning. Due to the high demand of multiple reasoning abilities to answer legal questions, the state-of-the-art models can only achieve about 28% accuracy on JEC-QA, while skilled humans and unskilled humans can reach 81% and 64% accuracy respectively, which indicates a huge gap between humans and machines on this task. We will release JEC-QA and our baselines to help improve the reasoning ability of machine comprehension models. You can access the dataset from http://jecqa.thunlp.org/.Comment: 9 pages, 2 figures, 10 tables, accepted by AAAI202

Adversarial Language Games for Advanced Natural Language Intelligence

We study the problem of adversarial language games, in which multiple agents with conflicting goals compete with each other via natural language interactions. While adversarial language games are ubiquitous in human activities, little attention has been devoted to this field in natural language processing. In this work, we propose a challenging adversarial language game called Adversarial Taboo as an example, in which an attacker and a defender compete around a target word. The attacker is tasked with inducing the defender to utter the target word invisible to the defender, while the defender is tasked with detecting the target word before being induced by the attacker. In Adversarial Taboo, a successful attacker must hide its intention and subtly induce the defender, while a competitive defender must be cautious with its utterances and infer the intention of the attacker. Such language abilities can facilitate many important downstream NLP tasks. To instantiate the game, we create a game environment and a competition platform. Comprehensive experiments and empirical studies on several baseline attack and defense strategies show promising and interesting results. Based on the analysis on the game and experiments, we discuss multiple promising directions for future research.Comment: Accepted by AAAI 202

The Cause and Correlation Network of Air Pollution from a Spatial Perspective: Evidence from the Beijing–Tianjin–Hebei Region

Based on the Spatial Durbin Model (SDM), this study evaluates the spatial spillover effect of PM2.5 concentration in Beijing–Tianjin–Hebei (BTH) and its surrounding areas from 2000 to 2016, analyzes its main influencing factors and verifies the Environmental Kuznets Curve (EKC). In addition, Social Network Analysis (SNA) is used to measure the regional air pollution transmission network. The results are as follows: (1) A significant inverted U-shaped EKC with spatial spillover effect between the sampled 48 cities was verified. (2) Industrial structure had both local and spillover effects on air pollution with a U-shaped curve; technological progress exerted a negative spillover effect on air pollution, while traffic evidenced positive local and spillover effects; meteorological conditions showed different impacts on air pollution. (3) Heze, Tianjin, Xingtai, Shijiazhuang and Liaocheng are the top five cities in the centrality of the air pollution correlation network, indicating air pollution in these cities have significant impacts on other cities within the network; while Sanmenxia, Weihai, Yuncheng, Langfang and Zhumadian are the bottom five cities, which indicates that the air pollution of these cities has the least correlation with other cities. The policy suggestions for 48 cities involve: building up a regional joint prevention and control mechanism, enhancing the supervision of cities located in the centrality of the air pollution correlation network, accelerating high-tech and service-oriented industrialization, encouraging technological innovation in energy conservation and environmental protection and implementing vehicle regulation

Iteratively Questioning and Answering for Interpretable Legal Judgment Prediction

Legal Judgment Prediction (LJP) aims to predict judgment results according to the facts of cases. In recent years, LJP has drawn increasing attention rapidly from both academia and the legal industry, as it can provide references for legal practitioners and is expected to promote judicial justice. However, the research to date usually suffers from the lack of interpretability, which may lead to ethical issues like inconsistent judgments or gender bias. In this paper, we present QAjudge, a model based on reinforcement learning to visualize the prediction process and give interpretable judgments. QAjudge follows two essential principles in legal systems across the world: Presumption of Innocence and Elemental Trial. During inference, a Question Net will select questions from the given set and an Answer Net will answer the question according to the fact description. Finally, a Predict Net will produce judgment results based on the answers. Reward functions are designed to minimize the number of questions asked. We conduct extensive experiments on several real-world datasets. Experimental results show that QAjudge can provide interpretable judgments while maintaining comparable performance with other state-of-the-art LJP models. The codes can be found from https://github.com/thunlp/QAjudge